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Abstract 

A one dimensional diffusion process X = {X t , < t < T}, with drift 
b{x) and diffusion coefficient a(9,x) — V9a(x) known up to 8 > 0, is 
supposed to switch volatility regime at some point t* 6 (0, T). On the basis 
of discrete time observations from X, the problem is the one of estimating 
the instant of change in the volatility structure t* as well as the two values 
of 6, say 6\ and 62, before and after the change point. It is assumed that the 
sampling occurs at regularly spaced times intervals of length A„ with nA„ = 
T. To work out our statistical problem we use a least squares approach. 
Consistency, rates of convergence and distributional results of the estimators 
are presented under an high frequency scheme. We also study the case of a 
diffusion process with unknown drift and unknown volatility but constant. 

Key words: discrete observations, diffusion process, change point problem, volatil- 
ity regime switch, nonparametric estimator. 



'email: alessandro.degegorio@unimi.it, stefano.iacus@unimi.it 



1 



1 Introduction 



Change point problems have originally arisen in the context of quality control, but 
the problem of abrupt changes in general arises in many contexts like epidemi- 
ology, rhythm analysis in electrocardiograms, seismic signal processing, study of 
archeological sites, financial markets. 

Originally, the problem was considered for i.i.d samples; see Hinkley (1971), 
Csorgo and Horvath (1997), Inclan and Tiao (1994) and it moved naturally into the 
time series context as economic time series often exhibit prominent evidence for 
structural change in the underlying model; see, for example, Kim et al. (2000), 
Lee et al. (2003), Chen et al. (2005) and the papers cited therein. 

In this paper we deal with a change-point problem for the volatility of a dif- 
fusion process observed at discrete times. The instant of the change in volatility 
regime is identified retrospectively by the method of the least squares along the 
lines proposed in Bai (1994). For continuous time observations of diffusion pro- 
cesses Lee et al. (2006) considered the change point estimation problem for the 
drift. In the present work the drift coefficient of the stochastic differential equation 
is assumed known and if not it is estimated nonparametrically. 

The paper is organized as follows. Section [2] introduces the model of observa- 
tion and the estimator of the change point instant and the estimators of the volatil- 
ities before and after the change. Section [3] analyzes the asymptotic properties of 
the estimators. In Section @] considers the case when the drift is unknown and the 
diffusion coefficient does not depend on the state of the process. All the proofs of 
the Theorems are contained in the Appendix. 

2 The least squares estimator 

We denote by X = {X t ,0 < t < T} the diffusion process, with state space 
/ = (I, r), — oo ^ / ^ r ^ +oo, solution of the stochastic differential equation 

dX t = b(X t )dt + \/0a(X t )dW t , (2.1) 

with Xq = xq and {Wt,t > 0} a standard Brownian motion. We suppose that 
the value of 6 is 6± up to some unknown time t* G (0, T) and #2 after, i.e. 9 = 
+ $2l{t>t*}- The parameters 9\ and 62 belong to 0, a compact set of M + . 
The coefficients b : I — > K and a : I — > (0, 00) are supposed to be known with 
continuous derivatives. The continuity of the derivatives of &(•) and cr(-) assures 
that it exists a unique continuous process solution to (I2.ll ). which is defined up an 
explosion time (see Arnold, 1974). Let s(x) = exp {- J* o 2b(u)/a 2 (u)du} be 
the scale function (where xq is an arbitrary point inside /). 

Al. lim Xl _+i s(u)du = —00, linx^^,. J^ 2 s(u)du = +00, where I < x% < 
x < X2 < r. 
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Condition Al guarantees that the exit time from / is infinite (see Karatzas and 
Shevre, 1991). 

The process X is observed at n + 1 equidistant discrete times = to < *i < 
... < t n = T, with t{ = iA n , nA n = T. For the sake of simplicity we will write 
Xi = X ti and = Wi. The asymptotic framework is an high frequency scheme: 
n —y oo, A n — > with nA n = T. Given the observations Xi,i = 0,1, n, the 
aim of this work is to estimate the change time t* as well as the two quantities 

In order to obtain a simple least squares estimator, we follow the same approach 
proposed in Bai (1994). To this end we make use of Euler approximation to the 
solution of (12.11) . i.e. 



X i+1 = Xi + b(Xi)A n + V9a(Xi)(W l+1 -Wi), 
and introduce the quantities 

_ X i+1 - Xi - b(Xi)A n ^W i+1 -Wi . 
Zi = — = vf — — — , 1 = 1, ...,n, 



^Ana(Xi) VA r 

which represent n independent standard normal variables. 

We denote by ko = [utq] and k = [nr], r, to E (0, 1), where [x] is the integer 
part of the real value x. Given that A n — ► 0, without loss of generality, we can 
assume that the process switches volatility regime exactly at time ij = tk = 
k$A n = t* . The least squares estimator of the change point is obtained as follows 



argmin min - 9 l f + £ (Zf - 9 2 ) 

V u 2 U=l i=fc+l 



k n \ 

gmin <| J2(Zf ~ h? + E ^ ~ ^) 2 . ( 2 - 2 ) 

i=l i=Jfc+l J 



ar, 



where 

k 



1 i=l i=l 



i=fe+l i=fe+l 

and = 1, n — 1. We introduce the following quantity 

k n 



1=1 i=Jfe+l 



3 



then we have that 



ko = argminC/f 



To study the asymptotic properties of f/| it is better to rewrite it in the following 
way 



i=l 



where Z n = ± £? =1 Z 1 = \ l S n and 



v k ={y^Y(h-v- SnDk 



ijk(n — k) 

with D k = k/n - S k /S n . 

This representation of £/f is obtained by lengthy but straightforward algebra 
and it is rather useful because minimization of f7| is equivalent to the maximization 
of Vk and hence D k . So it is easier to consider the following estimator of ko 

ko = arg max | D k \ = argmax(fc(n — fc))2|Vjfc| (2.3) 

k k 

As a side remark, it can be noticed that for fixed k (and under suitable hypoth- 
esis), Dk can be seen as an approximate likelihood ratio statistics for testing the 
null hypothesis of no change in volatility (see e.g. Inclan and Tiao, 1994). We do 
not discuss approximate likelihood approach in this paper. 

Once ko has been obtained, the following estimator of the parameters 9\ and 
02 can be used 

e x = J°, e 2 = ^4^. (2.4) 

ko n — ko 

We will prove consistency of ko, 0\ and 02 and also distributional results for these 
estimators. 

Our first result concerns the asymptotic distribution of the statistic Dk under 
the condition that no change of volatility occurs during the interval [0, T]. 

Theorem 2.1. Assume that Ho: 9% = O2 = 1 , then we have that 

2 \D k \S\W°(r)\ (2.5) 
where {W°(t),0 ^ r < 1} is a Brownian bridge. 

Corollary 2.1. From Theorem \2. l\ we derive immediately that for 5 £ (0, 1/2) 



J sup \D k \S sup \W°(r)\, (2.6) 

z Sn<k<{l-S)n <5<t<(1-<5) 

A /| sup \V k \S sup {r(l-T))- 1 / 2 \W°(T)\. (2.7) 

V z 8n<k<(l-S)n 6<t<(1-5) 
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The last asymptotic results are useful to test if a change point occurred in [0, T]. 
In particular it is possible to obtain the asymptotic critical values for the distribution 
(12.71 ) by means of the same arguments used in Csorgo and Horvath (1997), pag. 25. 



3 Asymptotic properties of the estimator 

We study the main asymptotic properties of the least squares estimator ko. We start 
analyzing the consistency and the rate of convergence of the change point estimator 
(12.31) . It is convenient to note that the rate of convergence is particularly important 
not only to describe how fast the estimator converges to the true value, but also to 
get the limiting distribution. The next Theorem represents our first result on the 
consistency. 

Theorem 3.1. The estimator tq = ^ satisfies 

\f - r \ = n- 1 l 2 {6 2 - e^Opisfi^n) (3.1) 

Theorem 13. 1 l implies consistency of our estimator, in fact we have that n^(fo — 
ro) —> in probability for any (3 G (0, 1/2). We are able to improve the rate of 
convergence of fo. 

Theorem 3.2. We have the following result 

f - t = O p ( - 1 - . (3.2) 



n(9 2 



n 



It is also possible to derive the asymptotic distribution of f under our limiting 
framework for small variations of the rate of change of the direction. The case 
"&n = @2 — 8i equal to a constant is less interesting because when $ n is large the 
estimate of ko is quite precise. By adding the condition 

A2. Assume that 

<& n 0, -> OO 

Under A2 the consistency of fo follows immediately either from Theorem 13.11 or 
Theorem l3.2i In order to obtain the next result, it is useful to observe that 

ko = argmax V fc 2 = argmaxra(V fc 2 — Vl ') (3.3) 

k k 

and to define a two-sided Brownian motion W(u) in the following manner 

W(u) = l W ^ U< ° (3.4) 

where W\, W 2 are two independent Brownian motions. Now we present the fol- 
lowing convergence in distribution result. 
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Theorem 3.3. Under assumption A2 we have that 



are max < W(v) > , (3.5) 

202 6 „ \ v > 2 J ' 

where W(v) is a two-sided Brownian motion and 6 is a consistent estimator for 9\ 
or 6 2 . 

Let #o be the limiting value of both 9\ and 02- Using the consistency result, we 
are able to obtain the asymptotic distributions for the estimators 61,62, defined in 

egb. 



Theorem 3.4. Under assumption A2 we have that 



where 

2r -\ 2 \ 

2(1 - r y% ) ■ (3 - 7) 

Remark 3.1. It is easy to verify that the Theorems presented in this Section are 
also true if we consider an horizon time tending to infinite, i.e. A n — > and 
nA n = T — > 00 as n — » 00. 



Remark on ergodic case. If the Euler approximation is not admissible, it is 
worth to consider the ergodic case. Let m(u) = (<t 2 (u)s(ii)) -1 be the speed 
measure of the diffusion process X t . We introduce the following assumptions: 

A3, m(x)dx < +00. 

A4. Xq = xq has distribution P°. 

Assumptions Al, A3 and A4 imply that the process X t is also ergodic and strictly 
stationary with invariant distribution P°(dx) = ir(x)dx, ir(x) = m(x)/ m(u)du. 
Under the additional condition: 



A5. lim-j^o ct(x)tt(x) = or lim^^oo 
a(x) 



cr\xm\x) 



and 



lim 

x->0 



2b(x) - a(x)a'(x) 



< 00 or lim 

X— >oo 



cr x 



2b(x) - a{x)a'(x) 



< 00 



the observed data Xi,i = 0,1, ...,n, is a strictly stationary /3-mixing sequence 
satisfying fik —> as k — > 00 for some fixed 5 > 1 (see e.g Ai't-Sahalia, 1996). 

Under this setup and nA n = T — > 00, similar results to the ones presented in 
the above can be obtained using the same techniques of Chen et al. (2005). 



6 



4 Estimation of the change point with unknown drift 



We want to analyze the change point problem for a diffusion process X t , when 
the drift coefficient b(X t ) is unknown, while the diffusion coefficient is supposed 
unknown but independent from the state of the process X t . In other words the 
process X t is the solution of the following reduced stochastic differential equation 

dX t = b(X t )dt + VOdWt, (4.1) 

and the observation scheme and the asymptotics are as in Section [2] Let K ^ 
be a kernel function, i.e. K is symmetric and continuously differentiable, with 
f R uK(u)du = 0, f m K 2 (u)du < oo and such that f R K(u)du = 1. We start 
introducing the following quantities 

ty _ Xi + i — Xi — b(Xi)A n 
£i — ?== 



where 



v^n tv- / Xj— x \ X i+ i—Xj 

h(x) = — — (4-2) 



is a nonparametric estimator of the drift constructed using the full sample and h n 
is the bandwidth defined as in Silverman (1986). The least squares estimator takes 
the following form 



{k 2 n 2 "j 

i=l i=k+l ) 



where 



a* &k 7i* Sn-k 

with S k = J2i=i Zf> S n -k = Y^i=k+l ^l- From (14.31 ). by the same steps consid- 
ered in the Section [2 we derive 

%={^^)\0l-ei) (4.4) 

We are able to show that the asymptotic properties of the estimator ko defined 
in (14.3b . are equal to the ones of ko- 

Theorem 4.1. The same results presented in the Theorems \3.1^3.4\ hold for the 
estimator ko- 
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5 Appendix 



As in Chen et at (2005) some of the proofs are based on the ones in Bai (1994). 
We adapt Bai's theorems making the appropriate (but crucial) adjustments when 
needed, skipping all algebraic calculations which can be found in the original paper 
of the author. 

Proof of Theorem \2~J\ By setting £j = Zf — 1, under Hq we note that Efe) = 
and Var(^i) = 2. Let us introduce the quantity 



Ynij) 



where S n = J27=i ^ s no narc ^ to see tnat 



' S [nr] + (nr - [nr])^=^ [nT ] + i, 
In v2n 



[n-rj 

S? 6 



[nr] 

Ef. 



i=l 



0, 



(5.1) 



and Var 



~ — S!=f £» ) = r - Since the Lindeberg condition is true 



i=l 



2ri 



(5.2) 



we can conclude that 



S [nT] ^N(0,r). 



'2n 



(5.3) 

By Donsker's theorem we have Y n — > W(r) that implies ^(r) — rl^(l) — > 
W°(r), where W(r) and W°(r) are respectively a standard Brownian motion and 
a Brownian bridge. Let [nr] = k, k = 1, 2, n, then 



y«(r) - rr„(l) 



1 



2n 
1 



<7 fc S 
Ofc o n 

n 



T 1 

^ S n + {nr - [nr])— =£ [nr]+1 



+ (nr - [nr])— L=£ [nT ] +1 . (5.4) 
v2n 



Now, by observing that 



5^ 5 n 

n 



i=i 



i=l 



from (15.41) we have that 



/n 



~ 2 \D k 



Ell ryl 
1=1 



X n (r)-rX n (l) 



(nr — [nr]) 



£[nr] 



+ 1 



(5.5) 
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As n oo, A n we get that ^% Z ' 2 -> 1 and (nr ^ TD g [nr]+1 0. Hence 
the thesis of Theorem follows. 

□ 

Proof of Theorem 1X71 By the same arguments of Bai (1994), Section 3 and by 
using the formulas (10)-(14) therein, we have that 



I r - r 1 < C TO (6 2 - Ox)' 1 sup\V k - EV k \, 

k 

where C TQ is a constant depending only on tq. Furthermore 



(5.6) 



Vk - EVh 



1 



1 



+ 



n V n yjn-k 
1 



=^+1 
k 



then we can write 



\V k -EV k \ < 



1 



1 



n I y/n — k 



i=fc+l 



+ 



E(^ 2 - f 



8=1 



(5.7) 



By applying Hajek-Renyi inequality for martingales we have that 



P I max 

Kk<n 



> a 



a 2 ^ <- 2 



k=l 



291 V - 

« 2 tA 



(5.8) 



Choosing c k = Vk and observing that Y^k=i k 1 < C log n, for some C > (see 
e.g. Bai, 1994), we have that 



k 

l<k<n y/k f-f 



max 



Op V lo g n • 



(5.9) 



The same result holds for = |X)I=fc+i(^ ~~ ^2) I' tnen f rom the relationships 
(15771 and (15791 we obtain the result (I37H. 



□ 

Proof of Theorem 1X2] We use the same framework of the proof of the Proposition 
3 in Bai (1994), Section 4, therefore we omit the details. 

We choose a 5 > such that tq G (5,1 — 5). Since ko/n is consistent for 
ro, for every e > 0, Pr{ko/n {5,1 — 5)} < e when n is large. In order to 
prove (13.21 ) it is sufficient to show that Pr{\f$ — tq\ > M(ra?^) } is small when 
n and M are large, where -d n = #2 — Q\ ■ We are interested to study the behavior 
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of V k for n5 < k < n(l - 5), < 5 < 1. We define for any M > the set 
D n M = : n 5 < k < n(l - 5), |& - fc | > M^ 2 }. Then we have that 

Pr{\r -r \ >«K)" 1 } <e + Pr{ sup | Vfe | > |^ |}, 

for every e > 0. Thus we study the behavior of Pr{sup fce£) M \V k \ > \ Vk \}. It is 
possible to prove that 



Pr { sup |Vfc| > \V ko \ } < Prl sup V k - V ko > 



+ Pr ^ sup K fc + y fco < 
P + Q 



(5.10) 



Furthermore 



Q < 2Pr { sup 



1 



fc<n(l-<5) n - k 
k 



=it+i 



> 



+2Pr < sup — 

fc>n<5 ^ 



£(2? - 01 



By observing that YliLm ^ 



2=1 

2 _ 



1 



(5.11) 



0(m ), the Hajek-Renyi inequality yields 

c, 



< 



9 ' 

arm 



(5.12) 



for some constant Ci < oo. The inequality (15.121 ) implies that (15.111 ) tends to zero 
as n tends to infinity. 

Let d(k) = \J ((k/n)(l — k/n)), k = 1, 2, n, for the first term in the right- 
hand of (15.101 ) we have that 



P < Pr < sup 



\G(k)\ > 



+ Pr < sup 

Pi + p 2 , 



n 



\H(k)\ > 



(5.13) 



where 



G(k) = d(k )±- J2(Zf - X ) - d{k)\ £(Z 2 " h) (5-14) 



8=1 
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H(k)=d(k)-1— £ ( Z : 

n — K ^-^ 



d(k ) 



1 

n — h 



o 



E (Zf-6 2 ) (5.15) 



=fe+l i=k +l 

We prove that P\ tends to zero when n and M are large. Thus we consider only 
k < ho or more precisely those values of k such that n5 < k < utq — Mi?~ 2 . For 
k > n5, we have 



\G(k)\ < 



ko — k 
n5kn 



k 



i=l 



+B 



ko — k 1 
n n5 



i=l 



+ 



1 

nS 



k 

E - ^ 

:=fc+i 

(5.16) 



where B > satisfies |d(fc ) - d(fc)l < P|fc - k\/n. By means of (EHJ, (l5~T2l) 
and (15.161 ). we obtain 



Pi < Pr 



1 



[nro] 

i=i 



> 



6 



+Pr < sup — 

Kk<n n 



i=l 



> 



TO 



6B 



+Pr < 



1 



sup 



< 



360f 



fc<nr -Mi9 
2 



-2 m~o — 



360 2 P 2 



[nro] 

E - »i 

i=fc+l 



> 



S# n C Tl 

6 



(<5C TO ) 2 T m? 2 (5C T0 yn$l 5C1M' 



When n and M are large the last three terms are negligible. Analogously we derive 
the proof of P 2 . 

□ 

Proof of Theorem [PI The proof follows the same steps in Bai (1994), Theorem 
1, hence we only sketch the parts of the proof that differ. We consider only v < 
because of symmetry. Let K n (v) = {k : k = [ko + v"&~ 2 ], —M < v < 0, M > 0} 
and 



A n (v)=n(v£-Vl) 



(5.17) 



with k G K n (v). We note that 



n(V k 2 -V k 2 Q ) = 2nEV ko (V k -V t 



ko) 



+2n(V ko -EV ko )(V k -V ko ) 
+n(V k - V h 



ko) 



(5.18) 



The last two terms in (15.181 ) are negligible on K n (v). Since \/n(V ko — EV ko ) is 
bounded by (15.71 ). we have to show that ^/n\V k — V ko \ is bounded. In particular, 
we can write 



yfc\V h - V ko \ < V^\G(k)+H(k)\ + yfc\EV k - EV ko \, 
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where G(k) and H(k) are denned respectively in (15.141) and (15.151) . The upper 
bound (15.161 ) is o p (l), because the first term is such that 



n- 



ko — k 
n5kn 



fco 
i=l 



< 



M 



fco 



4? £(3?-*) 



o P (i) 



(5.19) 



similarly for the second term and for the third term we apply the invariance princi- 
ple (I5.3I ). Now we explicit the limiting distribution for 



2nEV ko (V k - V ko ) = 2VTo(l-To)m?„(V [feo+w? - 2] - V ko ). 



(5.20) 



For simplicity we shall assume that fco + vd n 2 and vd n 2 are integers. We observe 
that 



n# n (V k - V ko ) = nMG(k) + H(k)) - n$ n {EV ko - EV k ), 



(5.21) 



where G(k), H(k) are defined in the expressions (15.141 ). (15.151) . We can rewrite 
G(k) as follws 



G(k)= d(k )^J2( Z "-^ + 



kka 



i=l 



d(fc ) - d(k) 
k 



8=1 



+ d(h)\ £ (Zf-9x). 



(5.22) 



i=fc+l 



By the same arguments used to prove (15.191) we can show that the first two terms 
in (15.221) multiplied by n&n are negligible on K n (M). Furthermore d(ko) = 
■\J ro(l — To) and n/k — > 1/tq for k 6 K n (M), then we get that 

n$ n G(k + v&- 2 ) = n$ n d(k )- £ (Z? - X ) + o p (l) 



i=fc+l 



|«|l?r, 



i=l 



d r o) r o 



\/2fii^i(-u) 



(5.23) 



where in the last step we have used the invariance principle (15.3I ). Analogously we 
can show that 



nKH(k +vK 2 ) - Vi ] T0)T ° V29 lWl (-v) 

1 - T 



(5.24) 
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Since 



we obtain that 



nMEVko ~ EV k ) - - 1 (5.25) 

Ww - r o) 



K{v) 4 2 |v^Wi(-t>) - y } • ( 5 - 26 ) 

In the same way, for v > 0, we can prove that 

A n (v) 4 2 W2B x W 2 {v) " y} • (5-27) 
By applying the continuous mapping theorem and Theorem [ 

n ^n(^0 - To) d 1 



26 2 26( 



argmax A„(t>). (5.28) 



Since aW(v) = W(a 2 v), a£l,a change in variable transforms argmax„ A n (v) 
into 29\ argmaxt, — ^| , which concludes the proof. □ 



Proof of Theorem [5761 We start noticing that 

y/n(k{h) ~ 9l(ko)) (5-29) 

( 1 feo i ko 

I i t fco i feo 



{fco>fco} 

fc - &o 



ko / 

Since ko = [tqu], ko = ko + O p ($~ 2 ), and ntf 2 — * cc, we have that ( 15.291 ) is 
{y/n , d n )~ 1 O p {l), which converges to zero in probability. Then 6\(ko) and 9\{ko) 
have the same limiting distribution. Obviously the same result holds for 02- Now 
it is easy to show that the limiting distribution of y/n{6\{ko),02{ko)) is equal to 
OH). 

□ 



Proof of Theorem Wl\ To prove our thesis it is sufficient to show that 

V^(V k - V k0 - {Vk -V ko ))^0. (5.30) 
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where Vk and Vk in this proof are the statistics obtained by setting a(X t ) = 1 into 
equation (12. II ). We rewrite the left-hand side of (15.301) as follows 







/ n 


H) 







r{Sn-k Sn— k) TK^k Sk) 

n — k k 



(5.31) 



'ko 



n 



kr 



nW- 1-- 



; \Sn— ko ^n~k a ) ~, ('S'fco <Stco) 
TL — Kq Kg 



The first term of (15.311 ) is equal to 

1 



k 



k 



nW- 1- - 
n \ n 



n — k k 



V v 7 L i=fc+l i=l 



n / 



fc\ 1 



n — k y n \ n/ ^/n — A; 



i=fc+l 



(5.32) 



We observe that 



«=l i=l i=l 



2^1+^2, 



(5.33) 



The next step is to prove that (15.331) tends to zero in probability. In fact, by simple 
calculations we can write 



W i+ i - Wi 



Vk ^ VA„ 

hv\: A (Wj+x - Wj) E"=i K 



Then we have that 



(9iA r 



i=l 



V^ n ( Xj—Xi 
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We note the following fact 



E{X j+1 -Xj-b{Xi)A n f 



= E i^/e[{W j+l - Wj) + jf J+ \b{X s ) - b(X t )]dsJ 
< 2 \o x E{W s+ x - Wjf + *>{j t HX S ) - b(X t )]ds 

2 I 9xA n + E ( f 3+ \b{X s ) - b(Xi)]ds) } . (5.34) 



Furthermore 



En 3+1 [b(X s )-b(Xi)]dsj =0(A 2 n ) (5.35) 

because the drift coefficient £>(•) has continuous derivatives, therefore is locally 
Lipschitz (see e.g. Ai't-Sahalia, 1996), and the process X t does not explode in a 
finite time. Then by means of relationships (15.341 ) and (15.351 ). we can claim that 



X j+1 - Xj - b(Xj)A ri 



OJ1). (5.36) 



The expression (15.361 ) allows us to write 

EjZ.Y^C^E (y m±^M ) =C9 1 A n ^0 
for some real constant C. The same arguments permit us to obtain that 

^ = %E(w-te)) 2 ^o. 

Similarly we can develop the second term of (15.311 ). so the proof is complete. 

□ 
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